Presenting a graphical representation of an ultrasound scanning volume

ABSTRACT

An image processing apparatus includes a display controller. The display controller is configured to arrange a foreground image in a three-dimensional space and display, on a display device, the foreground image as an inspection status image representing an inspection status by an ultrasonic wave. The foreground image includes a linear image being as an image including a plurality of linear images that change in accordance with a status of a probe and connect the center of a circle and a circumference of the circle with each other, a probe image that is located at the center of the circle and has a shape of the probe, and a spherical image being as a spherical image that represents a range to which the ultrasonic wave output from the probe is applied and has a cross section as the circle.

BACKGROUND

The present disclosure relates to an image processing apparatus and animage processing method, and more particularly to, an image processingapparatus and an image processing method that allow an operator whoperforms an ultrasonic inspection to easily grasp an inspection statusof the ultrasonic inspection, for example.

In order to prevent omission of scanning at any inspected part in anultrasonic inspection, there is proposed an ultrasonic inspection(diagnosis) apparatus that detects a position or a movement of a(ultrasonic) probe and expresses a track of the probe at an inspectedpart based on the position or the movement of the probe (for example,Japanese Patent Application Laid-open No. 2008-086742).

SUMMARY

In ultrasonic inspection apparatuses that perform ultrasonicinspections, a technique by which an operator who performs an ultrasonicinspection can easily grasp an inspection status of the ultrasonicinspection has been expected.

In view of the circumstances as described above, it is desirable for anoperator who performs an ultrasonic inspection to easily grasp aninspection status of the ultrasonic inspection.

According to an embodiment of the present disclosure, there is providedan image processing apparatus including a display controller configuredto arrange a foreground image in a three-dimensional space and display,on a display device, the foreground image as an inspection status imagerepresenting an inspection status by an ultrasonic wave, the foregroundimage including a linear image being as an image including a pluralityof linear images that change in accordance with a status of a probe andconnect the center of a circle and a circumference of the circle witheach other, a probe image that is located at the center of the circleand has a shape of the probe, and a spherical image being as a sphericalimage that represents a range to which the ultrasonic wave output fromthe probe is applied and has a cross section as the circle.

According to another embodiment of the present disclosure, there isprovided an image processing method including arranging a foregroundimage in a three-dimensional space and displaying, on a display device,the foreground image as an inspection status image representing aninspection status by an ultrasonic wave, the foreground image includinga linear image being as an image including a plurality of linear imagesthat change in accordance with a status of a probe and connect thecenter of a circle and a circumference of the circle with each other, aprobe image that is located at the center of the circle and has a shapeof the probe, and a spherical image being as a spherical image thatrepresents a range to which the ultrasonic wave output from the probe isapplied and has a cross section as the circle.

In the embodiments as described above, the foreground image includingthe linear image, the probe image, and the spherical image is arrangedin the three-dimensional space and displayed as an inspection statusimage representing an inspection status by an ultrasonic wave, on thedisplay device. The linear image is an image including a plurality oflinear images that change in accordance with a status of the probe andconnect the center of a circle and a circumference of the circle witheach other. The probe image is located at the center of the circle andhas a shape of the probe. The spherical image is a spherical image thatrepresents a range to which the ultrasonic wave output from the probe isapplied and has a cross section as the circle.

It should be noted that the image processing apparatus may be anindependent apparatus or may be an internal block constituting oneapparatus.

Further, when a computer is caused to execute a program, the computercan function as an image processing apparatus. A program causing thecomputer to function as an image processing apparatus can be provided bytransmission via a transmission medium or recording on a recordingmedium.

According to the present disclosure, it is possible to grasp aninspection status of an ultrasonic inspection. In particular, anoperator who performs an ultrasonic inspection can easily grasp aninspection status of the ultrasonic inspection.

These and other objects, features and advantages of the presentdisclosure will become more apparent in light of the following detaileddescription of best mode embodiments thereof, as illustrated in theaccompanying drawings.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing a configuration example of anembodiment of an ultrasonic inspection apparatus to which an imageprocessing apparatus according to an embodiment of the presentdisclosure is applied;

FIG. 2 is a diagram showing a state of the ultrasonic inspection;

FIG. 3 is a flowchart for describing processing of the ultrasonicinspection apparatus;

FIG. 4 is a diagram for describing a posture of a probe;

FIG. 5 is a diagram showing a display example of an inspection statusimage obtained when the probe is put on an inspection subject;

FIG. 6 is a diagram showing another display example of the inspectionstatus image obtained when the probe is being pressed against theinspection subject with a certain amount of force;

FIG. 7 is a diagram showing another display example of the inspectionstatus image obtained when the probe is being pressed against theinspection subject with a certain amount of force;

FIG. 8 is a diagram showing another display example of the inspectionstatus image obtained when the probe is rotated about an ultrasonic waveoutput direction while being pressed against the inspection subject;

FIG. 9 is a diagram showing another display example of the inspectionstatus image in which a direction image is drawn as a foreground imagein addition to a linear image, a probe image, and a spherical image;

FIG. 10 is a diagram showing another display example of the inspectionstatus image in which a texture of the spherical image is changed inaccordance with an inspection time period of the ultrasonic inspection;

FIG. 11 is a diagram showing another display example of the inspectionstatus image in which the foreground image that moves along with themovement of the probe within a three-dimensional space as a backgroundimage is drawn;

FIG. 12 is a diagram for describing rotation information;

FIG. 13 is a diagram for describing the drawing of a rotationinformation image at a corresponding point;

FIG. 14 is a diagram showing a display example of the spherical image inwhich an image other than a rectangular unit is adopted as the rotationinformation image;

FIG. 15 is a diagram showing a display example of a pinwheel unit asanother rotation information image;

FIG. 16 is a diagram showing another example of the spherical image; and

FIG. 17 is a block diagram showing a configuration example of anembodiment of a computer to which an embodiment of the presentdisclosure is applied.

DETAILED DESCRIPTION OF EMBODIMENTS One Embodiment of UltrasonicInspection Apparatus to Which One Embodiment of Present Disclosure isApplied

FIG. 1 is a block diagram showing a configuration example of anembodiment of an ultrasonic inspection apparatus to which an imageprocessing apparatus according to an embodiment of the presentdisclosure is applied.

The ultrasonic inspection apparatus is operated by an operator whoperforms an ultrasonic inspection. The ultrasonic inspection apparatuscaptures a cross-sectional image of each part such as abdomen of aninspection subject of an ultrasonic inspection by the use of anultrasonic wave. The image captured with the ultrasonic inspectionapparatus, that is, an ultrasonic image, is used in, for example,medical examinations by a doctor and the like.

It should be noted that the operator may be a third party other than theinspection subject, such as an engineer of the ultrasonic inspection, ormay be the inspection subject himself/herself.

In FIG. 1, the ultrasonic inspection apparatus includes a probe 10 and adata processing unit 20.

The probe 10 is an ultrasonic probe to output an ultrasonic wave and toreceive a reflected wave that come back by reflection of the ultrasonicwave on (the inside of the body of) the inspection subject. The probe 10includes an ultrasonic wave transmission/reception unit 11 and a sensingunit 12.

The ultrasonic wave transmission/reception unit 11 is provided at aleading end of the probe 10, for example. The ultrasonic wavetransmission/reception unit 11 generates and outputs an ultrasonic wave,receives a reflected wave of the ultrasonic wave, which is reflected onthe inspection subject, and supplies reflected wave data indicating theintensity of the reflected wave to a reflected wave data storage unit 21of the data processing unit 20.

The sensing unit 12 senses a physical amount that is necessary to detectthe status of the probe 10.

Specifically, the sensing unit 12 includes an acceleration sensor 12A,an angular velocity sensor 12B, a geomagnetic sensor 12C, a movementamount sensor 12D, an atmospheric pressure sensor 12E, a pressure sensor12F, and the like.

The acceleration sensor 12A detects an acceleration and an inclinationof the probe 10, for example.

The angular velocity sensor 12B detects an angular velocity and arotational angle of a rotation of the probe 10 in each direction ofpitch, yaw, and roll.

The geomagnetic sensor 12C detects an orientation (direction) of theprobe 10 with respect to a direction of geomagnetism, for example.

The movement amount (position) sensor 12D detects a movement amount ofthe probe 10 in a translation direction, for example.

The atmospheric pressure sensor 12E detects a position of the probe 10in a height direction by atmospheric pressure, for example.

The pressure sensor 12F detects a pressure (contact pressure) at whichthe probe 10 presses an inspection subject when the probe 10 is put onthe inspection subject.

The sensing unit 12 supplies data (sensor data) detected by theacceleration sensor 12A, the angular velocity sensor 12B, thegeomagnetic sensor 12C, the movement amount sensor 12D, the atmosphericpressure sensor 12E, the pressure sensor 12F, and the like to a sensordata storage unit 22 of the data processing unit 20.

It should be noted that the sensing unit 12 can be provided with anysensors to sense a physical amount that is necessary to detect thestatus of the probe 10, such as a gyroscope sensor and a gravity sensor,in addition to the acceleration sensor 12A to the pressure sensor 12F.

The data processing unit 20 uses the reflected wave data or sensor datasupplied from the probe 10 to generate an ultrasonic image or the likefor display.

The data processing unit 20 includes the reflected wave data storageunit 21, the sensor data storage unit 22, a status acquisition unit 23,a status storage unit 24, a history generation unit 25, a historystorage unit 26, a display controller 27, a display device 28, acontroller 29, and a storage 30.

The reflected wave data storage unit 21 stores the reflected wave datasupplied from the ultrasonic wave transmission/reception unit 11 of theprobe 10.

The sensor data storage unit 22 stores the sensor data supplied from thesensing unit 12 of the probe 10.

The status acquisition unit 23 detects and acquires the status of theprobe 10 at each time of day (timing at each predetermined interval)from the sensor data stored in the sensor data storage unit 22 and thensupplies the status to the status storage unit 24.

Here, the status of the probe 10 includes a pressure (F) of the probe 10that is put on the inspection subject, a position (Px, Py, Pz) of theprobe 10, a direction (Yaw, Pitch, Roll) of the probe 10, a movementspeed (Mx, My, Mz) in a translation direction of the probe 10, and thelike.

The pressure (F) of the probe 10 is detected based on the sensor data ofthe pressure sensor 12F, for example.

The position (Px, Py, Pz) of the probe 10 is detected based on thesensor data of the movement amount sensor 12D and the accelerationsensor 12A, for example. Further, the position (Px, Py, Pz) of the probe10 is represented in coordinates (x, y, z) of a three-dimensionalcoordinate system (hereinafter, referred to as probe coordinate system),for example. In the three-dimensional coordinate system, the position ofthe probe 10 that is put on an inspection subject in the last minute isset as the origin point, and the z axis is set as a direction ofgravity.

The direction (Yaw, Pitch, Roll) of the probe 10 represents a posture ofthe probe 10. The direction (Yaw, Pitch, Roll) of the probe 10 isdetected based on the sensor data of the acceleration sensor 12A, thegeomagnetic sensor 12C, and a gyroscope sensor (not shown), for example.Further, the direction (Yaw, Pitch, Roll) of the probe 10 is representedby a rotational angle of the yaw direction, a rotational angle of thepitch direction, and a rotational angle of the roll direction, in adirection in which the ultrasonic wave is output from the probe 10(ultrasonic wave output direction), for example.

The movement speed (Mx, My, Mz) of the probe 10 is detected based on thepositions (Px, Py, Pz) of the probe 10 at a plurality of continuoustimes of day and based on the plurality of continuous times of day, forexample.

It should be noted that the position (Px, Py, Pz) of the probe 10 isdetected based on the sensor data of the movement amount sensor 12D andthe acceleration sensor 12A and in addition, for example, the position(Px, Py, Pz) of the probe 10 at which a current ultrasonic image iscaptured (generated) can be detected by matching using ultrasonic imagesthat have been generated until then in the ultrasonic image generationunit 31 that will be described later.

The status storage unit 24 stores a status of the probe 10 at each timeof day, which is supplied from the status acquisition unit 23, inassociation with the time of day.

The history generation unit 25 generates a status history of the probe10 from a time when the probe 10 is put on the inspection subject in thelast minute to the moment, for example, using the status of the probe 10that is stored in the status storage unit 24. Then, the historygeneration unit 25 supplies the status history to the history storageunit 26.

Here, the status history of the probe 10 includes a total time period(T) during which the probe 10 at each posture is put on the inspectionsubject, a movement path and a movement distance of the probe 10 from atime when the probe 10 is put on the inspection subject in the lastminute to the moment, and the like.

The total time period (T) during which the probe 10 at each posture isput on the inspection subject is generated by totalizing times(inspection times) for each posture (direction) (Yaw, Pitch, Roll) ofthe probe 10 during which the probe 10 is put on the inspection subjectat the posture, for example.

The movement path of the probe 10 is generated as a trajectory includingthe position (Px, Py, Pz) of the probe 10, and the movement distance ofthe probe 10 is generated from the position (Px, Py, Pz) of the probe10.

The history storage unit 26 stores the status history of the probe 10,which is supplied from the history generation unit 25.

The display controller 27 performs display control to display anultrasonic image, an inspection status image, and a predeterminedmessage on the display device 28.

Specifically, the display controller 27 includes an ultrasonic imagegeneration unit 31, an inspection status image generation unit 32, and amessage generation unit 33.

The ultrasonic image generation unit 31 generates, as an ultrasonicimage, an image in which the reflected wave data (the intensity of thereflected wave of the ultrasonic wave reflected on the inspectionsubject) stored in the reflected wave data storage unit 21 is consideredas a pixel value (brightness), for example. Then, the ultrasonic imagegeneration unit 31 supplies the image to the display device 28 fordisplay.

Here, the ultrasonic wave transmission/reception unit 11 generates anultrasonic wave and receives a reflected wave of the ultrasonic wave,and the ultrasonic image generation unit 31 generates an ultrasonicimage by using the reflected wave data indicating the intensity of thereflected wave. Such processing corresponds to capturing of anultrasonic image.

It should be noted that the ultrasonic image generation unit 31 canadditionally generate, as an ultrasonic image, a cross-sectional imageof a part such as abdomen by using the reflected wave data obtained bymoving the probe 10 so as to go round the part.

The inspection status image generation unit 32 draws (generates) aninspection status image that represents the status of an inspection bythe ultrasonic wave, by using the status of the probe 10 that is storedin the status storage unit 24 and the status history of the probe 10that is stored in the history storage unit 26. Then, the inspectionstatus image generation unit 32 supplies the inspection status image tothe display device 28 for display.

For example, the message generation unit 33 generates a message foradvice on an ultrasonic inspection method, by using the status of theprobe 10 that is stored in the storage unit 24 and the status history ofthe probe 10 that is stored in the history storage unit 26. Then, themessage generation unit 33 supplies the message to the display device 28for display.

It should be noted that the display and non-display of the inspectionstatus image or the message can be switched according to an operation ofan operator, for example.

The display device 28 is constituted of an LCD (Liquid Crystal Display),an organic EL (Electro Luminescence) display, or the like. The displaydevice 28 displays the ultrasonic image, the inspection status image, orthe message according to the display control of the display controller27.

The controller 29 controls the blocks that constitute the probe 10 andthe blocks that constitute the data processing unit 20.

Further, the controller 29 sets (adjusts) a parameter of the probe 10according to an operation of the operator, for example.

Here, examples of the parameter of the probe 10 include the type of theprobe 10 (linear type, convex type, etc.), the number of piezoelectricelements that generate ultrasonic waves and receive reflected wavesthereof in the probe 10, the frequency of an ultrasonic wave, the depth(to what depth the inspection is performed), a focus, a frame rate(frame rate in the case where an ultrasonic image is captured as amoving image), and the like. The controller 29 sets adjustableparameters (for example, frequency and focus of the ultrasonic wave)according to the operation of the operator.

The storage 30 associates the ultrasonic image generated in theultrasonic image generation unit 31, the inspection status imagegenerated in the inspection status image generation unit 32 when theultrasonic image is generated, and the message generated in the messagegeneration unit 33 with one another as necessary and then stores them.

It should be noted that in FIG. 1, the status of the probe 10 isdetected using the sensor data that is output by the sensing unit 12provided in the probe 10, but the status of the probe 10 can be detectedby any other methods.

For example, the position of the probe 10 can be detected with use of adetection apparatus that detects a three-dimensional position of anobject. As the detection apparatus that detects a three-dimensionalposition of an object, for example, there are a POLARIS (of an opticalsystem) manufactured by NDI (Northern Digital Inc.), a medSAFE (of amagnetic system) manufactured by Ascension Technology Corporation, andthe like.

Further, in FIG. 1, the display device 28 is included in the dataprocessing unit 20, but the data processing unit 20 can be configuredwithout including the display device 28.

FIG. 2 is a diagram showing a state of the ultrasonic inspection.

The ultrasonic inspection is performed by putting a part of the probe10, at which an ultrasonic wave is output and a reflected wave isreceived, on a part whose ultrasonic image is intended to be obtained.

In FIG. 2, the probe 10 is being put on abdomen of an inspection subjectlying down on his/her back.

FIG. 3 is a flowchart for describing processing of the ultrasonicinspection apparatus of FIG. 1.

In Step S11, the ultrasonic wave transmission/reception unit 11 startsto generate an ultrasonic wave according to an operation of an operator,for example. For example, the ultrasonic wave transmission/receptionunit 11 generates a pulse-like ultrasonic wave at predeterminedintervals and performs ultrasonic wave scanning in a predetermineddirection.

In Step S12, the sensing unit 12 starts to sense a physical amountnecessary to detect the status of the probe 10.

Sensor data obtained by the sensing of the sensing unit 12 is suppliedto the sensor data storage unit 22 and then stored therein.

In Step S13, the status acquisition unit 23 starts to detect the statusof the probe 10 by using the sensor data stored in the sensor datastorage unit 22, and the history generation unit 25 starts to generate astatus history of the probe 10 by using the status of the probe 10 thatis detected by the status acquisition unit 23 (and stored in the statusstorage unit 24).

The status of the probe 10 that is detected by the status acquisitionunit 23 is supplied to the status storage unit 24 and stored therein inassociation with a time of day. Further, the status history of the probe10 that is generated in the history generation unit 25 is supplied tothe history storage unit 26 and then stored therein.

In Step S14, the ultrasonic wave transmission/reception unit 11 startsto receive a reflected wave of the ultrasonic wave.

Reflected wave data indicating the intensity of the reflected wavereceived in the ultrasonic wave transmission/reception unit 11 issupplied to the reflected wave data storage unit 21 and stored therein.

In Step S15, the ultrasonic image generation unit 31 generates, as anultrasonic image, an image in which the reflected wave data stored inthe reflected wave data storage unit 21 is considered as a pixel value,for example.

Further, in Step S15, the inspection status image generation unit 32generates an inspection status image by using the status of the probe 10that is stored in the status storage unit 24 and the status history ofthe probe 10 that is stored in the history storage unit 26.

Furthermore, in Step S15, the message generation unit 33 generates anecessary message by using the status of the probe 10 that is stored inthe status storage unit 24 and the status history of the probe 10 thatis stored in the history storage unit 26.

In Step S16, the ultrasonic image generation unit 31 supplies theultrasonic image to the display device 28 for display. In addition, inStep S16, the inspection status image generation unit 32 supplies theinspection status image to the display device 28 for display. Moreover,in Step S16, the message generation unit 33 supplies the necessarymessage to the display device 28 for display.

In Step S17, the controller 29 determines whether the ultrasonicinspection is continued or not.

In Step S17, in the case where it is determined that the ultrasonicinspection is continued, in other words, for example, in the case wherethe operator has not performed an operation of stopping the ultrasonicinspection, the processing returns to Step S15 and the same processingis repeated from Step S15.

Alternatively, in the case where it is determined in Step S17 that theultrasonic inspection is not continued, in other words, for example, inthe case where the operator has performed an operation of stopping theultrasonic inspection, the processing is terminated.

FIG. 4 is a diagram for describing a posture of the probe 10.

The posture of the probe 10 is represented by the direction (Yaw, Pitch,Roll) of the probe 10. The direction (Yaw, Pitch, Roll) of the probe 10is represented by a rotational angle of the yaw direction, a rotationalangle of the pitch direction, and a rotational angle of the rolldirection, in a direction in which the ultrasonic wave is output fromthe probe 10 (ultrasonic wave output direction).

It is assumed that the position of the probe 10 when the probe 10 is puton the inspection subject in the last minute is set as the origin point,and a three-dimensional coordinate system with the z axis being adirection of gravity is set as a probe coordinate system. In this case,the rotational angle of the pitch direction represents a rotationalangle about an x axis of the probe coordinate system, the rotationalangle of the roll direction represents a rotational angle about a y axisof the probe coordinate system, and the rotational angle of the yawdirection represents a rotational angle about the z axis of the probecoordinate system.

Here, in order to simplify the description, it is assumed that the probe10 has a shape of a cuboid. The cuboid serves as the probe 10 in a statein which the ultrasonic wave output direction coincides with the z axisof the probe coordinate system. The status of the physical appearance ofthe probe 10 is identical between a case where one surface of the cuboidthat is parallel to the ultrasonic wave output direction, that is, afront surface 10A, faces the front as shown in FIG. 4, for example, andthe other case where the front surface 10A rotates by 180 degrees aboutthe z axis and faces the opposite side. However, the two cases aredifferent from each other in the rotational angle of the yaw direction,and thus different from each other in the posture of the probe 10.

It should be noted that the x axis and the y axis of the probecoordinate system can be determined from directions orthogonal to the zaxis by any method. Further, although FIG. 4 shows an x axis and a yaxis of an ultrasonic image coordinate system, the x axis and the y axisof the ultrasonic image coordinate system represent a lateral directionand a longitudinal direction of the ultrasonic image, respectively,which differ from the x axis and the y axis of the probe coordinatesystem.

Inspection Status Image

Hereinafter, display examples of the inspection status image that isgenerated (drawn) in the inspection status image generation unit 32 willbe described.

FIG. 5 is a diagram showing a display example of the inspection statusimage obtained when the probe 10 is put on an inspection subject.

For example, the inspection status image is an image in which aforeground image serving as a linear image 51, a probe image 52, and aspherical image 53 is arranged in a virtual three-dimensional spaceserving as a background image.

The linear image 51 includes a plurality of linear images that connectthe center of a predetermined circle and a circumference of thepredetermined circle. In FIG. 5, eight lines are drawn as a plurality oflines that connect the center of a predetermined circle and acircumference of the predetermined circle.

The linear image 51 changes in accordance with the status of the probe10 as will be described later.

The probe image 52 is an image in the shape of the probe 10. In FIG. 5,(an image of) a cuboid is adopted as the probe image 52.

A circle with the position of the probe image 52 being as the center isadopted as the predetermined circle used when the linear image 51 isdrawn. Therefore, the probe image 52 is positioned at the center of thepredetermined circle used when the linear image 51 is drawn.

It should be noted that the cuboid as the probe image 52 can be drawnsuch that a part from which an ultrasonic wave is output is visuallyrecognized. In FIG. 5, a part of the cuboid as the probe image 52, fromwhich an ultrasonic wave is output, is drawn in a translucent manner.

The probe image 52 changes in accordance with the status of the probe10.

For example, as shown in FIG. 2, in the case where the probe 10 is beingput on the inspection subject lying down such that the ultrasonic waveoutput direction is (substantially) perpendicular to the inspectionsubject, the probe image 52 is drawn such that the ultrasonic waveoutput direction is perpendicular to the predetermined circle used whenthe linear image 51 is drawn.

Then, for example, when the probe 10 is inclined, the probe image 52 isinclined similarly. In other words, the probe image 52 is redrawn toshow a state in which the probe image 52 is inclined similarly to theprobe 10.

It should be noted that in the case of adopting a cuboid or the likeshown in FIG. 5 as the probe image 52, it is difficult to distinguishthe case where the front surface 10A of the probe 10 faces the frontfrom the case where the front surface 10A rotates by 180 degrees aboutthe z axis and faces the opposite side, as described with reference toFIG. 4.

In this regard, on a surface of the cuboid as the probe image 52, whichcorresponds to the front surface 10A of the probe 10, a mark or the likeindicating that the surface corresponds to the front surface 10A can bedrawn. In this case, the operator can easily grasp a direction in whichthe front surface 10A of the probe 10 faces.

The spherical image 53 is a (hemi)spherical image representing a rangeto which an ultrasonic wave output from the probe 10 is applied. Thespherical image 53 has a cross section as the predetermined circle usedwhen the linear image 51 is drawn.

The center of the hemisphere as the spherical image 53 is the center ofthe predetermined circle used when the linear image 51 is drawn, thatis, the position where the probe image 52 is positioned. Therefore, bythe spherical image 53, the operator can imagine the range inside of thebody of the inspection subject, to which an ultrasonic wave output fromthe probe 10 is applied, the probe 10 being put on the body surface ofthe inspection subject.

In order to ensure the visibility, the inside of the hemisphere as thespherical image 53 is a hollow so as to see the inside (back side) onthe depth side of the hemisphere.

It should be noted that in FIG. 5, a point of view is present on anupper side on the front of the hemisphere as the spherical image 53. Interms of ensuring the visibility of the inside on the depth side of thehemisphere as the spherical image 53 as much as possible withoutchanging the point of view, the surface (spherical surface) of thehemisphere as the spherical image 53 is drawn in a transparent(translucent) manner.

Here, in FIG. 5, the cross section of the hemisphere as the sphericalimage 53, that is, the predetermined circle used when the linear image51 is drawn, is closely analogous to a regular octagon.

Further, in FIG. 5, the spherical image 53 is drawn in wireframe. Thesurface of the hemisphere as the spherical image 53 is sectioned intosmall areas by lines L1 and L2 that are drawn in a grid form and serveas wireframe.

In other words, the surface of the hemisphere as the spherical image 53is sectioned into small areas each having a substantially rectangularshape by the lines L1 and the lines L2. The lines L1 connect, along withthe surface of the hemisphere, opposed vertices of cross sections of thehemisphere that are each closely analogous to a regular octagon. Thelines L2 are obtained by intersections of a plurality of flat surfacesand the hemisphere. The plurality of flat surfaces are parallel to thecross section of the hemisphere and arranged at regular intervals.

It should be noted that when the probe 10 is put on the inspectionsubject in a state where the inspection subject stands up, the linearimage 51, the probe image 52, and the spherical image 53 that serve asthe foreground image can be drawn in a 90-degrees rotated state from thestate of FIG. 2. In this case, the operator can easily imagine that anultrasonic inspection for the inspection subject who is standing up isbeing performed.

FIG. 6 is a diagram showing another display example of the inspectionstatus image obtained when the probe 10 is being pressed against theinspection subject with a certain amount of force.

It should be noted that in FIG. 6, for simple description, the positionof the probe 10 is not transferred, and the posture thereof is notchanged.

In the case where the probe 10 is being pressed against the inspectionsubject, the plurality of lines serving as the linear image 51 aredeflected in accordance with a pressure of the probe 10 that is beingpressed against the inspection subject.

In other words, the plurality of lines serving as the linear image 51are drawn so as to be deflected in accordance with the pressure of theprobe 10 that is being pressed against the inspection subject.

By the deflection corresponding to the pressure of the probe 10 that isbeing pressed against the inspection subject, which is given to theplurality of lines serving as the linear image 51, the operator canvisually recognize the amount of the pressure of the probe 10.

It should be noted that as to the plurality of lines serving as thelinear image 51, the deflection can be given thereto and the color orthickness thereof can be changed, in accordance with the pressure of theprobe 10 that is being pressed against the inspection subject.

For example, in the case where the pressure of the probe 10 that isbeing pressed against the inspection subject becomes stronger, the coloror thickness of the plurality of lines serving as the linear image 51can be changed in order that the operator can imagine that the pressureof the probe 10 becomes stronger. For example, the plurality of linesserving as the linear image 51 can be changed in color from a light redcolor to a deep red color or changed in thickness from a thick line to athin line.

Further, in the case where the pressure of the probe 10 becomesstronger, the plurality of lines serving as the linear image 51 can bechanged in thickness from a thin line to a thick line. When the pressureof the probe 10 is strong and the plurality of lines serving as thelinear image 51 are drawn in a thick line, an impression that the probe10 is hard to press any more can be given to the operator.

FIG. 7 is a diagram showing another display example of the inspectionstatus image obtained when the probe 10 is being pressed against theinspection subject with a certain amount of force.

It should be noted that also in FIG. 7, the position of the probe 10 isnot transferred, and the posture thereof is not changed.

In FIG. 7, the probe image 52 functions as a level meter that indicatesthe pressure of the probe 10.

Specifically, in FIG. 7, the color or brightness of the cuboid as theprobe image 52 is changed in a vertical direction from the bottom of thecuboid in accordance with the pressure of the probe 10 that is beingpressed against the inspection subject.

As a result, the color or brightness of the cuboid as the probe image 52is changed from the bottom of the cuboid in accordance with the pressureof the probe 10 such that a bar graph expands or contracts. In otherwords, as the pressure of the probe 10 becomes stronger, the color orbrightness of the cuboid as the probe image 52 changes such that a bargraph expands.

Thus, the operator can visually recognize the amount of the pressure ofthe probe 10.

It should be noted that in FIG. 7, the probe image 52 that functions asa level meter of a pressure is provided with marks as a scale of thelevel meter. The marks represent that the pressure of the probe 10 istoo weak (Weak), proper (Proper), and too strong (Strong).

With those marks, the operator can determine whether the pressure of theprobe 10 is proper or not.

Further, in FIG. 7, the pressure of the probe 10 is weak (too weak).Therefore, a message for advice on an inspection method for anultrasonic inspection, “Pressure is slightly weak”, is generated in themessage generation unit 33 and displayed.

As to whether the pressure of the probe 10 is proper or not, forexample, a pressure database in which a proper pressure for each partthat is subjected to the ultrasonic inspection is registered is storedin the message generation unit 33, and a part that is subjected to theultrasonic inspection is input by the operator. Thus, whether thepressure of the probe 10 is proper or not can be determined withreference to the pressure database in the message generation unit 33.

Here, in FIG. 7, the indication of “F=5 [kPa]” represents a specificnumerical value of the pressure of the probe 10 (pressure at which theprobe 10 is pressed against the inspection subject).

Further, in FIG. 7, the indications of “Px=0 [mm]”, “Py=0 [mm]”, and“Pz=0 [mm]” represent the position (Px, Py, Pz) of the probe 10(coordinates of the probe coordinate system).

Using the status of the probe 10 that is stored in the status storageunit 24, the display controller 27 can display a specific numericalvalue of the pressure of the probe 10 and the position (Px, Py, Pz) ofthe probe 10 as described above.

FIG. 8 is a diagram showing another display example of the inspectionstatus image obtained when the probe 10 is rotated about the ultrasonicwave output direction while being pressed against the inspectionsubject.

It should be noted that in FIG. 8, for simple description, the positionof the probe 10 is not transferred, and the pressure thereof is notchanged.

In the case where the probe 10 is rotated about the ultrasonic waveoutput direction while being pressed against the inspection subject,that is, the probe 10 is twisted, the plurality of lines serving as thelinear image 51 are twisted in accordance with an amount of the twist ofthe probe 10.

Specifically, the plurality of lines serving as the linear image 51 aredrawn such that the twist occurs in accordance with an amount of thetwist of the probe 10.

The twist corresponding to the amount of the twist of the probe 10 isadded to the plurality of lines serving as the linear image 51. Thus,the operator can visually recognize the amount of the twist of the probe10.

It should be noted that as to the plurality of lines serving as thelinear image 51, the twist can be added thereto and the color orthickness thereof can be changed, in accordance with the amount of thetwist of the probe 10.

The inspection status image generation unit 32 recognizes the amount ofthe twist of the probe 10 based on the posture of the probe 10 (thedirection (Yaw, Pitch, Roll) of the probe 10). Then, the inspectionstatus image generation unit 32 redraws the plurality of lines servingas the linear image 51 that are twisted in accordance with the amount ofthe twist of the probe 10.

FIG. 9 is a diagram showing another display example of the inspectionstatus image in which a direction image is drawn as the foreground imagein addition to the linear image 51, the probe image 52, and thespherical image 53.

It should be noted that in FIG. 9, for simple description, the positionof the probe 10 is not transferred, and the pressure thereof is notchanged.

The direction image is an image indicating the ultrasonic wave outputdirection (direction in which the ultrasonic wave is output from theprobe 10). In FIG. 9, as the direction image, a direction arrow image 61and a direction point image 62 are drawn.

The direction arrow image 61 is an image of an arrow extending in theultrasonic wave output direction with the center of the hemisphere asthe spherical image 53 (center of the predetermined circle used when thelinear image 51 is drawn) being as a starting point.

The inspection status image generation unit 32 recognizes the direction(Yaw, Pitch, Roll) of the probe 10 as the ultrasonic wave outputdirection and draws, as the direction arrow image 61, an image of anarrow extending in the ultrasonic wave output direction from the centerof the hemisphere as the spherical image 53.

The direction point image 62 is an image that is drawn at anintersection between a line extending in the ultrasonic wave outputdirection from the center of the hemisphere as the spherical image 53and the surface of the hemisphere as the spherical image 53 and thatcauses the operator to imagine that a beam is applied to theintersection.

The inspection status image generation unit 32 detects the intersectionbetween the line extending in the ultrasonic wave output direction fromthe center of the hemisphere as the spherical image 53 and the surfaceof the hemisphere as the spherical image 53 and draws the directionpoint image 62 at the position of the intersection.

With the direction arrow image 61 and the direction point image 62 asthe direction image, the operator can easily grasp the direction inwhich the ultrasonic inspection is performed (direction in which theultrasonic wave is applied).

Here, in FIG. 9, the indications of “Px=0 [mm]”, “Py=0 [mm]”, and “Pz=0[mm]” represent the position (Px, Py, Pz) of the probe 10 as describedwith reference to FIG. 7.

Further, the indications of the “Yaw=10 [°]”, “Pitch=20 [°]”, and“Roll=30 [°]” represent the posture of the probe 10 (the direction (Yaw,Pitch, Roll) of the probe 10).

Using the status of the probe 10 that is stored in the status storageunit 24, the display controller 27 can display the position (Px, Py, Pz)of the probe 10 and the direction (Yaw, Pitch, Roll) of the probe 10 asdescribed above.

It should be noted that FIG. 9 shows both the direction arrow image 61and the direction point image 62 that serve as the direction image, butonly one of the direction arrow image 61 and the direction point image62 can be displayed as the direction image.

Further, the direction point image 62 can be blinked.

Furthermore, a display status of the direction arrow image 61 and thatof the direction point image 62 can be changed in accordance with theintensity, frequency, or the like of the ultrasonic wave that is outputfrom the probe 10.

For example, the arrow as the direction arrow image 61 can be madethicker as the intensity of the ultrasonic wave that is output from theprobe 10 becomes stronger. In this case, with the direction arrow image61, the operator can easily grasp the level of the intensity of theultrasonic wave that is output from the probe 10.

In addition, for example, the direction point image 62 can be blinked athigher speed as the frequency of the ultrasonic wave that is output fromthe probe 10 becomes higher.

FIG. 10 is a diagram showing another display example of the inspectionstatus image in which a texture of the spherical image 53 is changed inaccordance with an inspection time period of the ultrasonic inspection.

It should be noted that in FIG. 10, for simple description, the positionof the probe 10 is not transferred, and the pressure thereof is notchanged.

In accordance with the inspection time period of the ultrasonicinspection in a direction from the center of the hemisphere as thespherical image 53 toward a predetermined position on the surface of thehemisphere, the inspection status image generation unit 32 can changethe texture of the predetermined position.

Specifically, the inspection status image generation unit 32 sets thesmall areas, by which the surface of the hemisphere as the sphericalimage 53 is sectioned and which have been described with reference toFIG. 5, to be units for presenting the inspection time period of theultrasonic inspection (time presentation unit). The inspection statusimage generation unit 32 changes the texture of each time presentationunit in accordance with an integration value of time periods duringwhich the ultrasonic wave is applied to the time presentation unit.

In this case, the operator can easily grasp a direction in which theultrasonic inspection is not performed (in which the ultrasonic wave isnot applied) (when viewed from the center of the hemisphere as thespherical image 53, that is, from the position of the probe 10) or adirection in which the ultrasonic inspection is not sufficientlyperformed (in which a reflected wave of the ultrasonic wave is notsufficiently received).

Here, in the inspection status image generation unit 32, the integrationvalue of the time period during which the ultrasonic wave is applied tothe time presentation unit is obtained using the status history of theprobe 10.

It should be noted that in FIG. 10, the texture of the time presentationunit is drawn so as to distinguish at least a direction in which theultrasonic wave has never been applied (in which the inspection timeperiod of the ultrasonic inspection is 0) (Never), a direction in whichthe ultrasonic wave has been applied but the application of theultrasonic wave is not sufficient (in which the inspection time periodis insufficient) (Once), and a direction in which the ultrasonic wave issufficiently applied (in which the inspection time period is enough)(Enough).

Further, in FIG. 10, in the message generation unit 33, a message foradvising the operator to perform an ultrasonic inspection (of a timepresentation unit) in a direction in which the ultrasonic wave has notbeen applied, “This angle is not inspected”, is generated and displayedwith a speech balloon pointing to a time presentation unit in adirection in which the ultrasonic wave has not been applied.

Additionally, in FIG. 10, the indications of “Px=0 [mm]”, “Py=0 [mm]”,and “Pz=0 [mm]” and the indications of “Yaw=10 [°]”, “Pitch=20 [°]”, and“Roll=30 [°]” represent the position (Px, Py, Pz) of the probe 10 andthe posture of the probe 10 (the direction (Yaw, Pitch, Roll) of theprobe 10), as in the case of FIG. 9.

Here, in the case where an inspection subject who has been subjected tothe ultrasonic inspection in the past is subjected to an ultrasonicinspection for the same part as that have been subjected to the pastultrasonic inspection, matching is performed in the status acquisitionunit 23 between an ultrasonic image obtained in the past ultrasonicinspection and an ultrasonic image obtained in the ultrasonic inspectionin this time. Then, for example, using the probe coordinate system usedin the past ultrasonic inspection, the status of the probe 10 in theultrasonic inspection in this time can be detected.

In this case, in the inspection status image generation unit 32, inaccordance with an inspection time period obtained by integrating timeperiods from the past ultrasonic inspection to the ultrasonic inspectionin this time, the texture of the time presentation unit can be changed.

FIG. 11 is a diagram showing another display example of the inspectionstatus image in which the foreground image that moves along with themovement of the probe 10 within a three-dimensional space as thebackground image is drawn.

It should be noted that in FIG. 11, for simple description, the postureand the pressure of the probe 10 are not changed.

FIG. 11 shows a display example of the inspection status image obtainedwhen the operator moves the probe 10 from the front side to the deepside.

In the case where the operator moves the probe 10, the inspection statusimage generation unit 32 moves the linear image 51, the probe image 52,and the spherical image 53 as the foreground image within thethree-dimensional space as the background image according to themovement of the probe 10.

Specifically, the inspection status image generation unit 32 draws anddisplays an inspection status image in which the foreground image isarranged at (a position corresponding to) a current position of theprobe 10 being moved, within the three-dimensional space as thebackground image.

Here, when the foreground image is moved within the three-dimensionalspace, as shown in FIG. 11, the inspection status image generation unit32 can also draw the foreground images at (positions corresponding to)one or more past positions of the probe 10 being moved, in addition tothe current position of the probe 10 being moved, within thethree-dimensional space as the background image.

In FIG. 11, the foreground images are drawn at two past positions of theprobe 10 being moved, in addition to the current position of the probe10 being moved.

The inspection status image generation unit 32 can determine intervals(crude density) between the positions at which the foreground images aredrawn, in accordance with a speed at which the probe 10 is moved.

For example, at intervals at which a moving speed of the probe 10 isfast, positions at which the foreground images are drawn are roughlydetermined. At intervals at which the moving speed of the probe 10 isslow, the positions at which the foreground images are drawn are denselydetermined.

In this case, the operator can visually recognize the moving speed ofthe probe 10.

It should be noted that the foreground images drawn at the pastpositions can be merely deleted after the lapse of a predeterminedperiod of time or can be set to increase the degree of transparencyalong with the lapse of time and eventually deleted, for example.

Further, when the foreground images are drawn, a foreground imagelocated on the front side within the three-dimensional space is drawn ina large size, and a foreground image located on the deep side within thethree-dimensional space is drawn in a small size so that the operatorhas a sense of perspective.

Here, in FIG. 11, the indications of “Px=50 [mm]”, “Py=80 [mm]”, and“Pz=0 [mm]” represent the position (Px, Py, Pz) of the probe 10 asdescribed with reference to FIG. 7.

Further, the indications of “Mx=5 [mm/sec]”, “My=8 [mm/sec]”, and “Mz=0[mm/sec]” represent the movement speed (Mx, My, Mz) in the translationdirection of the probe 10.

Additionally, the indication of “Distance=94 [mm]” represents a movementdistance of the probe 10.

Using the status of the probe 10 that is stored in the status storageunit 24, the display controller 27 can display the position (Px, Py, Pz)of the probe 10 and the movement speed (Mx, My, Mz) of the probe 10.Further, using the status history of the probe 10 that is stored in thehistory storage unit 26, the display controller 27 can display themovement distance of the probe 10.

Further, in FIG. 11, (an image of) an arrow indicated by a dotted lineis a transfer path image representing a transfer path of the probe 10.The inspection status image generation unit 32 can draw the transferpath image by using the status history of the probe 10 that is stored inthe history storage unit 26.

Hereinafter, with reference to FIGS. 12 to 16, an inspection statusimage in which a rotation information image is drawn in addition to thelinear image 51, the probe image 52, and the spherical image 53 as theforeground image will be described.

It should be noted that in the following description, for simpledescription, the position of the probe 10 is not transferred, and thepressure thereof is not changed.

The inspection status image generation unit 32 can draw an imagerepresenting rotation information on a rotation of the probe 10, as arotation information image in the foreground image. In this case, therotation information on the rotation of the probe 10 is obtained whenthe probe 10 is rotated about the ultrasonic wave output direction whilekeeping a state directed from the center of the hemisphere as thespherical image 53 to a predetermined position on the surface of thehemisphere.

FIG. 12 is a diagram for describing the rotation information.

As shown in FIG. 12, the ultrasonic wave output direction of the probe10 in the state being directed from the center of the hemisphere as thespherical image 53 to a predetermined position on the surface of thehemisphere has a one-on-one correspondence with an intersection betweenthe hemisphere as the spherical image 53 and a line extending from thecenter of the hemisphere in the ultrasonic wave output direction.

Therefore, each point on the hemisphere as the spherical image 53represents the ultrasonic wave output direction that has a one-on-onecorrespondence with the point.

As the rotation information, as shown in FIG. 12, for example, anintegrated time period (hereinafter, also referred to as integratedinspection time period) during which the probe 10 is put at eachrotational angle can be adopted. The rotational angle is obtained whenthe probe 10 is rotated about an ultrasonic wave output directionrepresented by each point on the hemisphere as the spherical image 53.

The integrated inspection time period during which the probe 10 is putat each rotational angle about the ultrasonic wave output directionrepresented by each point on the hemisphere as the spherical image 53(hereinafter, also referred to as a point on the spherical image 53) canbe obtained using the total time period (T) during which the probe 10 ateach posture is put on the inspection subject. The total time period (T)is stored as the status history of the probe 10 in the history storageunit 26.

As the rotational angle of the probe 10 about the ultrasonic wave outputdirection represented by each point on the spherical image 53, forexample, values in the range of 0 to 360 degrees can be adopted. In therange, a rotational angle when the probe 10 is directed in theultrasonic wave output direction is set to 0 degrees, and angles inclockwise rotation are set to be positive angles.

In this case, for example, it is assumed that the probe 10 is directedin an ultrasonic wave output direction represented by a certain point onthe spherical image 53 and may be rotated clockwise and counterclockwiseup to 180 degrees at the maximum about the ultrasonic wave outputdirection. In this case, a rotational angle when the probe 10 is rotatedclockwise is in the range of 0 to 180 degrees, and a rotational anglewhen the probe 10 is rotated counterclockwise is in the range of 360 to180 degrees.

In the case where an integrated inspection time period at eachrotational angle is adopted as the rotation information, for example,the sum of all integrated inspection time periods in the range of 0 to360 degrees, the sum of integrated inspection time periods in eachpredetermined range of rotational angles, e.g., 30 degrees each, can beadopted as an integrated inspection time period serving as the rotationinformation.

For example, in the case where the sum of all the integrated inspectiontime periods in the range of 0 to 360 degrees is adopted as the rotationinformation, the rotation information represents a time period(inspection time period) during which the probe 10 is being directed inthe ultrasonic wave output direction represented by each point on thespherical image 53.

For example, in the case where the sum of all the integrated inspectiontime periods in the range of 180 degrees each is adopted as the rotationinformation, the rotation information represents a time period duringwhich the probe 10 is rotated clockwise (rotated by a rotational anglein the range of 0 to 180 degrees) about the ultrasonic wave outputdirection represented by each point on the spherical image 53 and a timeperiod during which the probe 10 is rotated counterclockwise (rotated bya rotational angle in the range of 360 to 180 degrees) about theultrasonic wave output direction represented by each point on thespherical image 53.

As described above, each point on the hemisphere as the spherical image53 represents an ultrasonic wave output direction that has a one-on-onecorrespondence with the point. Therefore, a rotation information imagethat represents rotation information on a rotation when the probe 10 isrotated about a certain ultrasonic wave output direction can be drawn ata point (hereinafter, referred to as corresponding point) on thehemisphere as the spherical image 53. The point represents theultrasonic wave output direction.

FIG. 13 is a diagram for describing the drawing of a rotationinformation image at a corresponding point.

For example, in the case where the hemisphere as the spherical image 53is sectioned into small areas each having a substantially rectangularshape as described with reference to FIG. 5, a rotation informationimage can be drawn in each of the small areas. The rotation informationimage represents rotation information on a rotation of the probe 10about an ultrasonic wave output direction represented by a correspondingpoint included in the small area.

Here, as the rotation information on a rotation of the probe 10 about anultrasonic wave output direction represented by a corresponding pointincluded in a certain small area R (hereinafter, also referred to asrotation information of a small area R), for example, rotationinformation on a rotation of the probe 10 about an ultrasonic waveoutput direction represented by one corresponding point that isrepresentative of corresponding points included in that small area R isadopted.

Further, as the rotation information of the small area R, for example,the sum of integrated inspection time periods for all correspondingpoints included in that small area R, the integrated inspection timeperiods each serving as the rotation information on the rotation of theprobe 10 about an ultrasonic wave output direction represented by acorresponding point included in that small area R, can be adopted.

It is assumed that for example, as described with reference to FIG. 12,the sum of all the integrated inspection time periods in the range of 0to 360 degrees, that is, a time period (inspection time period) duringwhich the probe 10 is put in an ultrasonic wave output directionrepresented by a certain corresponding point, is adopted as rotationinformation on the rotation of the probe 10 about the ultrasonic waveoutput direction represented by the certain corresponding point. In thiscase, as the rotation information image, a rectangular unit that is animage having the same shape (rectangular shape) as the small area and isarranged to overlap each small area is adopted, and the brightness orcolor of the rectangular unit can be changed in accordance with theintegrated inspection time period as the rotation information of thesmall area in which the rectangular unit is arranged.

It should be noted that as shown in FIG. 13, the size of the small areais adjustable in accordance with the capability (resource) of theultrasonic inspection apparatus or an operation of a user. For example,the size of the small area can be reduced more as the capability of theultrasonic inspection apparatus is higher.

In FIG. 13, the spherical image 53 on the left side has a larger size ofthe small area, that is, the small area becomes rougher, and thespherical image 53 on the right side has a smaller size of the smallarea, that is, the small area becomes finer.

As the size of the small area becomes smaller, the granularity of therotation information image and of the rotation information becomesfiner.

When the size of the small area becomes smaller and the small area isconstituted of one pixel for example, each pixel of the spherical image53 is drawn in brightness or color corresponding to the rotationinformation on the rotation of the probe 10 about an ultrasonic waveoutput direction. In the ultrasonic wave output direction, the positionof the pixel is set as a corresponding point.

FIG. 14 is a diagram showing a display example of the spherical image 53in which an image other than the rectangular unit is adopted as therotation information image.

As the rotation information image, for example, a round unit, a cubicunit, and a sphere unit can be adopted in addition to the rectangularunit.

Here, the round unit is a round image that is arranged in each smallarea of the spherical image 53 and has the size that fits within thesmall area. The cubic unit is a cubic image that is arranged in eachsmall area of the spherical image 53 and has the size that fits withinthe small area. The sphere unit is a spherical image that is arranged ineach small area of the spherical image 53 and has the size that fitswithin the small area.

It is assumed that for example, the sum of all integrated inspectiontime periods in the range of 0 to 360 degrees, that is, a time period(inspection time period) during which the probe 10 is put in anultrasonic wave output direction represented by a certain correspondingpoint, is adopted as rotation information on a rotation of the probe 10about the ultrasonic wave output direction represented by the certaincorresponding point. In this case, for example, the round unit as therotation information image changes in accordance with the inspectiontime period as rotation information of a small area in which the roundunit is arranged.

Specifically, for example, as the integrated inspection time period asrotation information of a small area is longer, the inspection statusimage generation unit 32 draws a larger-size round unit as a round unitto be arranged in the small area.

The same holds true for the cubic unit and the sphere unit.

In the case where the round unit is adopted as the rotation informationimage, and for example, a time period during which the probe 10 isrotated clockwise and a time period during which the probe 10 is rotatedcounterclockwise, which are described with reference to FIG. 12, areadopted as rotation information on a rotation of the probe 10 about anultrasonic wave output direction represented by a certain correspondingpoint, the inspection status image generation unit 32 can draw a roundunit as seen in FIG. 14 in an enlarged manner.

Specifically, the inspection status image generation unit 32 can draw around unit having a right-side semicircle and a left-side semicircle. Inthe right-side semicircle of a circle as the round unit, a sectorportion with a central angle corresponding to the time period duringwhich the probe 10 is rotated clockwise is painted. In the left-sidesemicircle of the circle as the round unit, a sector portion with acentral angle corresponding to the time period during which the probe 10is rotated counterclockwise is painted.

FIG. 15 is a diagram showing a display example of a pinwheel unit asanother rotation information image.

As the rotation information image, a pinwheel unit can be adopted inaddition to the rectangular unit, the round unit, the cubic unit, andthe sphere unit described above.

The pinwheel unit is an image in the shape of a pinwheel. The pinwheelunit is an image that has the size fitting within a small area of thespherical image 53 and is arranged in each small area of the sphericalimage 53, as in the case of the round unit and the like.

In the case where for example, a time period during which the probe 10is rotated clockwise and a time period during which the probe 10 isrotated counterclockwise, which are described with reference to FIG. 12,are adopted as rotation information on a rotation of the probe 10 aboutan ultrasonic wave output direction represented by a certaincorresponding point, and when the pinwheel unit is adopted as therotation information image, the inspection status image generation unit32 changes a rotating speed of the pinwheel as the pinwheel unit inaccordance with the time period during which the probe 10 is rotatedclockwise and the time period during which the probe 10 is rotatedcounterclockwise, for example. Additionally, the inspection status imagegeneration unit 32 changes a rotation direction of the pinwheel as thepinwheel unit in accordance with the time period during which the probe10 is rotated clockwise, the time period during which the probe 10 isrotated counterclockwise, and a magnitude relation.

It should be noted that a triangular pyramid unit having a triangularpyramid shape can be adopted as the rotation information image otherthan the above-mentioned units, for example. In the case where atriangular pyramid unit is adopted as the rotation information image,the inspection status image generation unit 32 changes the size of thetriangular pyramid unit in accordance with the time period during whichthe probe 10 is rotated clockwise and the time period during which theprobe 10 is rotated counterclockwise. Additionally, the inspectionstatus image generation unit 32 changes a direction of a vertex of thetriangular pyramid unit in accordance with the time period during whichthe probe 10 is rotated clockwise, the time period during which theprobe 10 is rotated counterclockwise, and a magnitude relation.

FIG. 16 is a diagram showing another example of the spherical image 53.

In FIG. 16, the spherical image 53 is formed of two layers, an outerhemisphere image 53A and an inner hemisphere image 53B.

In the spherical image 53 formed of the two layers as described above, arotation information image of one of the clockwise rotation and thecounterclockwise rotation can be arranged on one of the outer hemisphereimage 53A and the inner hemisphere image 53B, and a rotation informationimage of the other rotation can be arranged on the other hemisphereimage.

Specifically, for example, a spherical unit or the like whose size ischanged in accordance with the time period of the clockwise rotation canbe arranged on the outer hemisphere image 53A to serve as an rotationinformation image of the clockwise rotation, and a spherical unit or thelike whose size is changed in accordance with the time period of thecounterclockwise rotation can be arranged on the inner hemisphere image53B to serve as an rotation information image of the counterclockwiserotation.

In the case where the spherical image 53 is formed of two layers, it isdesirable to properly adjust the degree of transparency on the frontside in order to ensure the visibility on the deep side.

As described above, in the ultrasonic inspection apparatus shown in FIG.1, the foreground image including the linear image 51, the probe image52, and the spherical image 53 is arranged within the three-dimensionalspace to be displayed as an inspection status image. Then, for example,the linear image 51 is changed in accordance with the status of theprobe 10 as shown in FIGS. 6, 8, and the like. Thus, the operator caneasily grasp an inspection status of the ultrasonic inspection.

Further, in the ultrasonic inspection apparatus shown in FIG. 1, forexample, the texture of the spherical image 53 is changed in accordancewith the inspection time period of the ultrasonic inspection asdescribed with reference to FIG. 10. Thus, any inspection can beprevented from being omitted.

Further, in the ultrasonic inspection apparatus shown in FIG. 1, forexample, the message for advice on the inspection method is displayed asdescribed with reference to FIG. 7. Thus, the operator can understand amore appropriate operation for the probe 10.

It should be noted that in the ultrasonic inspection apparatus shown inFIG. 1, the status of the probe 10 and the status history of the probe10 (hereinafter, also referred to as probe status information) that areused to generate the inspection status image in the inspection statusimage generation unit 32 can be stored in the storage 30.

In this case, using probe status information obtained when an ultrasonicinspection has been performed previously on an inspection subject, aninspection status image is generated and displayed. Thus, the operatorcan perform an ultrasonic inspection in the same quality as in theprevious ultrasonic inspection.

Further, using probe status information obtained when a skilled operatorhas performed an ultrasonic inspection, an inspection status image isgenerated and displayed. Thus, the technique of an unskilled operator inthe ultrasonic inspection can be improved.

In addition thereto, for example, inspection status images generatedusing probe status information obtained when different operators performultrasonic inspections are compared to each other. Thus, the techniqueof each operator in the ultrasonic inspection can be evaluated to begood or poor.

It should be noted that in the ultrasonic inspection apparatus shown inFIG. 1, an image showing parameters such as the depth of a vertex and afocus position of the probe 10 can be included in the inspection statusimage and displayed.

Description on Computer to which Embodiment of Present Disclosure isApplied

The series of processing described above can be performed by hardware orsoftware. In the case where the series of processing is performed bysoftware, a program constituting the software is installed in ageneral-purpose computer and the like.

In this regard, FIG. 17 shows a configuration example of an embodimentof a computer in which a program for executing the series of processingdescribed above is installed.

The program can be stored in advance in a hard disk 105 or a ROM (ReadOnly Memory) 103 as a built-in recording medium of the computer.

Alternatively, the program can be stored (recorded) in (on) a removablerecording medium 111. Such a removable recording medium 111 can beprovided as so-called package software. Here, examples of the removablerecording medium 111 include a flexible disc, a CD-ROM (Compact DiscRead Only Memory), an MO (Magneto Optical) disc, a DVD (DigitalVersatile Disc), a magnetic disc, and a semiconductor memory.

It should be noted that the program can be installed from the removablerecording medium 111 as described above in the computer, or can bedownloaded in the computer via a communication network or a broadcastnetwork and then installed in the built-in hard disk 105. In otherwords, for example, the program can be transferred wirelessly to thecomputer from a download site via a satellite for digital satellitebroadcasting or can be transferred to the computer by cable via anetwork such as a LAN (Local Area Network) and the Internet.

The computer incorporates a CPU (Central Processing Unit) 102. The CPU102 is connected with an input/output interface 110 via a bus 101.

When receiving, via the input/output interface 110, a command input by auser operating an input unit 107, for example, the CPU 102 executes theprogram stored in the ROM 103 according to the command. Alternatively,the CPU 102 loads the program stored in the hard disk 105 to a RAM(Random Access Memory) 104 and then executes the program.

Accordingly, the CPU 102 performs the processing according to theflowchart described above or the processing performed by theconfiguration of the block diagram described above. Then, asappropriate, the CPU 102 causes an output unit 106 to output aprocessing result or causes a communication unit 108 to transmit theprocessing result via the input/output interface 110, or causes the harddisk 105 to record the processing result thereon, for example.

It should be noted that the input unit 107 is constituted of a keyboard,a mouse, a microphone, and the like. Further, the output unit 106 isconstituted of an LCD (Liquid Crystal Display), a speaker, and the like.

Here, in this specification, the processing performed by the computeraccording to the program is not necessarily performed in chronologicalorder along the order described as the flowchart. Specifically, theprocessing performed by the computer according to the program includesprocessing executed in parallel or individually (for example, parallelprocessing or processing by object).

Further, the program may be processed by one computer (processor) ordistributed and processed by a plurality of computers. Further, theprogram may be transferred to a distant computer and then executedthereby.

It should be noted that the embodiment of the present disclosure is notlimited to the embodiment described above and can be variously modifiedwithout departing from the gist of the present disclosure.

For example, the present disclosure can have a configuration of cloudcomputing in which a plurality of apparatuses share one function andcooperate to perform processing via a network.

Further, the steps described in the flowchart described above can beexecuted by one apparatus or shared and executed by a plurality ofapparatuses.

In addition, in the case where one step includes a plurality ofprocessing steps, the plurality of processing steps in one step can beexecuted by one apparatus or shared and executed by a plurality ofapparatuses.

It should be noted that the present disclosure can take the followingconfigurations.

(1) An image processing apparatus, including

-   -   a display controller configured to arrange a foreground image in        a three-dimensional space and display, on a display device, the        foreground image as an inspection status image representing an        inspection status by an ultrasonic wave, the foreground image        including        -   a linear image being as an image including a plurality of            linear images that change in accordance with a status of a            probe and connect the center of a circle and a circumference            of the circle with each other,        -   a probe image that is located at the center of the circle            and has a shape of the probe, and        -   a spherical image being as a spherical image that represents            a range to which the ultrasonic wave output from the probe            is applied and has a cross section as the circle.            (2) The image processing apparatus according to (1), in            which    -   the display controller is configured to deflect a plurality of        lines serving as the linear image in accordance with a pressure        of the probe being put on an inspection subject of an ultrasonic        inspection.        (3) The image processing apparatus according to (1) or (2), in        which    -   the display controller is configured to twist a plurality of        lines serving as the linear image in accordance with an amount        of twist of the probe being put on an inspection subject of an        ultrasonic inspection.        (4) The image processing apparatus according to any one of (1)        to (3), in which    -   the spherical image includes wireframe.        (5) The image processing apparatus according to any one of (1)        to (4), in which    -   the foreground image includes a direction image representing a        direction of the ultrasonic wave output by the probe located at        the center of the circle.        (6) The image processing apparatus according to any one of (1)        to (5), in which    -   the display controller is configured to change a texture of a        predetermined position in accordance with an inspection time        period in a direction from the center of the circle to the        predetermined position on a surface of a sphere as the spherical        image.        (7) The image processing apparatus according to any one of (1)        to (6), in which    -   the display controller is configured to move the foreground        image within the three-dimensional space along with a movement        of the probe.        (8) The image processing apparatus according to any one of (1)        to (7), in which    -   the foreground image includes an rotation information image        representing information of a rotation of the probe when the        probe directed from the center of the circle to a predetermined        position on a surface of a sphere as the spherical image is        rotated about a direction in which the ultrasonic wave is        output.        (9) The image processing apparatus according to any one of (1)        to (8), in which    -   the display controller is configured to change the probe image        in accordance with a change of the status of the probe.        (10) The image processing apparatus according to any one of (1)        to (9), in which    -   the display controller is configured to display a message for        advice on an inspection method, based on the status of the        probe.        (11) The image processing apparatus according to (10), in which    -   the display controller is configured to display the message        based on one of a pressure of the probe being put on an        inspection subject of an ultrasonic inspection and an inspection        time period in a direction from the center of the circle to a        predetermined position on a surface of a sphere as the spherical        image.        (12) An image processing method, including    -   arranging a foreground image in a three-dimensional space and        displaying, on a display device, the foreground image as an        inspection status image representing an inspection status by an        ultrasonic wave, the foreground image including        -   a linear image being as an image including a plurality of            linear images that change in accordance with a status of a            probe and connect the center of a circle and a circumference            of the circle with each other,        -   a probe image that is located at the center of the circle            and has a shape of the probe, and        -   a spherical image being as a spherical image that represents            a range to which the ultrasonic wave output from the probe            is applied and has a cross section as the circle.

The present disclosure contains subject matter related to that disclosedin Japanese Priority Patent Application JP 2012-114010 filed in theJapan Patent Office on May 18, 2012, the entire content of which ishereby incorporated by reference.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

What is claimed is:
 1. An image processing apparatus, comprising atleast one processor configured to control display, on a display device,of an inspection status image representing an inspection status by anultrasonic wave, wherein the inspection status image includes: a rangeimage that represents a range to which an ultrasonic wave output from aprobe is applied in a three-dimensional space, wherein the range imagehas a cross section, in a horizontal plane with respect to a tip of theprobe, as a substantive circle, and wherein a plurality of lines connecta center of the substantive circle with a circumference of thesubstantive circle; and a probe image at the center of the substantivecircle, wherein the probe image has a shape of the probe, and whereinthe probe image comprises an image of a level meter indicator thatindicates a pressure of the probe.
 2. The image processing apparatusaccording to claim 1, wherein the center of the substantive circlecorresponds to a position of the probe put on a subject for anultrasonic inspection.
 3. The image processing apparatus according toclaim 1, wherein the substantive circle is comprised of a polygon. 4.The image processing apparatus according to claim 1, wherein the atleast one processor is further configured to deflect the plurality oflines based on a pressure of the probe on a subject for an ultrasonicinspection.
 5. The image processing apparatus according to claim 1,wherein the at least one processor is further configured to twist theplurality of lines based on an amount of twist of the probe on a subjectfor an ultrasonic inspection.
 6. The image processing apparatusaccording to claim 1, wherein the range image includes wireframe.
 7. Theimage processing apparatus according to claim 1, wherein the inspectionstatus image includes a direction image representing a direction of theultrasonic wave, and wherein the ultrasonic wave is output by the probethat is at the center of the substantive circle.
 8. The image processingapparatus according to claim 2, wherein the at least one processor isfurther configured to change texture of a specific position, on asurface of a sphere as the range image, based on a time period of theultrasonic inspection, and wherein the texture is changed in a directionfrom the center of the substantive circle to the specified position. 9.The image processing apparatus according to claim 1, wherein the atleast one processor is further configured to move the inspection statusimage within the three-dimensional space along with a movement of theprobe.
 10. The image processing apparatus according to claim 1, whereinthe inspection status image includes rotation information representinginformation of a rotation of the probe based on the probe which isdirected from the center of the substantive circle to a position on asurface of a sphere and wherein the probe image is rotated about adirection in which the ultrasonic wave is output.
 11. The imageprocessing apparatus according to claim 1, wherein the at least oneprocessor is further configured to change the probe image based on achange of a status of the probe.
 12. The image processing apparatusaccording to claim 2, wherein the at least one processor is furtherconfigured to control, based on a status of the probe, the displaydevice to display a message that includes an advice on the ultrasonicinspection.
 13. The image processing apparatus according to claim 12,wherein the at least one processor is further configured to control thedisplay device to display the message, based on a pressure of the probethat is put on the subject of the ultrasonic inspection and a timeperiod of the ultrasonic inspection in a direction from the center ofthe substantive circle to a specific position on a surface of a sphereas the range image.
 14. The image processing apparatus according toclaim 1, wherein at least one line of the plurality of lines changesbased on a status of the probe, and wherein the status of the probeincludes one of a pressure of the probe, a position of the probe, adirection of the probe, or a movement speed in a translation directionof the probe.
 15. The image processing apparatus according to claim 1,wherein the at least one processor is further configured to detect astatus of the probe at specific time intervals based on data from atleast one sensor.
 16. An image processing method, comprising controllingdisplaying, on a display device, an inspection status image representingan inspection status by an ultrasonic wave, wherein the inspectionstatus image includes: a range image that represents a range to which anultrasonic wave output from a probe is applied in a three-dimensionalspace, wherein the range image has a cross section, in a horizontalplane with respect to a tip of the probe, as a substantive circle, andwherein a plurality of lines connect a center of the substantive circlewith a circumference of the substantive circle; and a probe image at thecenter of the substantive circle, wherein the probe image has a shape ofthe probe, and wherein the probe image comprises an image of a levelmeter indicator that indicates a pressure of the probe.
 17. The imageprocessing method according to claim 16, wherein at least one line ofthe plurality of lines changes based on a status of the probe, andwherein the status of the probe includes one of a pressure of the probe,a position of the probe, a direction of the probe, or a movement speedin a translation direction of the probe.
 18. The image processing methodaccording to claim 16, wherein the inspection status image furtherincludes a direction image representing a direction of the ultrasonicwave, wherein the ultrasonic wave is output by the probe that is at thecenter of the substantive circle.